Copyright © 1972 American Telephone and Telegraph Company 

The Bell System Technical Journal 

Vol. 51, No. 4, April, 1972 

Printed in U.S.A. 



The Spectral Density of a Coded 
Digital Signal 

By B. S. BOSIK 

(Manuscript received August 23, 1971) 

The stochastic process appearing at the output oj a digital encoder is 
investigated. Based upon the statistics of the code being employed, a sys- 
tematic procedure is developed by means oj which the average power spectral 
density of the process can be determined. The method is readily programmed 
on the digital computer, facilitating the calculation of the spectral densities 
for large numbers of codes. As an example of its use, the procedure is 
applied in the case of a specific multi-alphabet, multi-level code. 

I. INTRODUCTION 

Iii recent years, increased interest has been focused on more complex 
multi-alphabet, multi-level codes. 1-4 Such codes are designed to produce 
a digital pulse train with specific spectral properties making it suitable 
for transmission over digital repeatered lines. These properties generally 
include the absence of a dc component and a strong spectral component 
from which timing can be extracted. This paper presents a method for 
calculating the spectral composition of the pulse trains resulting from 
the use of these codes. The procedure is applicable to a wide variety 
of codes. 

A code may be defined as a set of mappings from a set of input 
symbols (or words) to a set of codewords. Each mapping is called an 
alphabet. The code may use different alphabets depending upon the 
state of the coded signal. 1 It is desirable for unique decipherability 
that the set of mappings be one-to-one, i.e., that no matter to how 
many alphabets a codeword belongs, it always corresponds to the same 
input symbol. However, this restriction will not be imposed here. 

In general, when the code is applied to a sequence of input symbols, 
the resulting encoded signal is a stochastic process, the statistics of 
which depend on the input symbol sequence statistics and the code 
statistics. For convenience, a random input symbol sequence will be 
assumed so that the input symbols are equally likely. Even if the 
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symbols are not equiprobable, the procedure for calculating the spectral 
density outlined in Section III remains valid, although the methods 
for calculating the required signal statistics described in Section IV 
must be modified. The spectral density derivation only becomes in- 
applicable when the statistics of the input symbols vary with time, 
so that the ergodicity and stationarity assumptions of Sections II 
and III are no longer valid. 

The codes to be considered in this paper will have N states, each 
state corresponding to a single alphabet. The alphabet assignment 
need not be unique, i.e., more than one state can correspond to the 
same alphabet. The codes will have a block length L and the number 
of codeword symbol values (levels) will be M . 

II. THE CODED SIGNAL 

The codeword symbols are, in general, transmitted on some standard 
pulse shape g(t) at intervals of duration T. The signal, then, may be 
expressed by 

xit) = £ a n g{t - nT) (1) 

n = — oo 

where a n is the codeword symbol value for the time slot nT ^ t ^ 
(n -f- 1)7\ The values which {a n } assume are determined by the code 
and the input symbols which are to be coded. The discrete parameter 
random process formed by the sequence of codeword symbols {a n \ 
has an autocorrelation function R(k) = E{a n a n+k ], and, thus, is assumed 
to be wide-sense stationary. The autocorrelation function of the coded 
signal x{t) is, then, 

RXt + t, = E S R(m - n)g{t + r - nT)g(t - mT) (2) 

n = — oo m = — oo 

which is, in general, a function of both t and t. The coded signal is not, 
therefore, wide-sense stationary. However, it is easily shown that 
Rz(t + t, t) is periodic in t with period T. The coded signal is, then, 
a cyclostationary process. 

III. THE POWER SPECTRAL DENSITY OF THE SIGNAL 

Since the coded signal is not a wide-sense stationary random process, 
the Fourier transform relationship between the autocorrelation function 
and the power spectral density cannot be invoked to find its power 
spectrum. However, the average power spectral density of a cyclo- 
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stationary process of the form described above has been derived by 
W. R. Bennett. 5 Under the assumption that the process is ergodic, 
the spectral density is 

v>„(j) = | | G(j) | 2 [ff(0) + 2JE R(k) cos 2*kfTj (3) 

where G(j) is the Fourier transform of g(t). The determination of the 
spectral density, then, requires the calculation of the autocorrelation 
function R(k). 

A method of calculating R(k) can be derived as follows. Let the 
probability of being in state i during time slot n be 

p( Sn = s t ) = P(s<y, t- 1,2, ...,jv (4) 

and let the probability that the symbol a n assumes the value A t , I = 
1, 2, • ■ ■ , M, and a n+k assumes the value A m , m = 1,2, ••• , M, given 
that s n = *S, be 

P(a n = A t , a n+k = A m \s n = S,) = P k (A t , A m \ S,). (5) 

Then R(k) can be expressed as 

N M U 

R(k) = E P(S<) E E A l A n P k {Ai , ^ m I S t ). (6) 

i-l r-l m-l 

But in time slot n, there is a probability of 1/L of being in the jth 
symbol, o, , of a codeword, j = 1, 2, ■ • • , L. Thus, 

P k {A l , A m | S t ) = E jP k (A t , A m | S t , ;). (7) 

Substituting eq. (7) in eq. (6), we obtain 

1 AT L M M 

R(k) = t T,P(Si) E E E A l A m P k {A l , A m | St , i). (8) 

Li , = i , = l |-i m -i 

Now define 

R Si (j, j + k) = E E ^,J\(^ , A m | 5, , j) 

1 = 1 m-l 

= # a ,{a,a, + *}; j = 1,2, ••• , L. (9) 

Thus, 

ft(*0 = f E WO E RsXi, j + fc). (10) 

The equation by which R Si (j, j + k) is calculated is a function of 
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both j and k. The values of j and k determine the relative positions of 
the codewords to which the symbols a, and a i+k belong. This knowledge 
combined with a knowledge of the coded signal statistics allows the 
calculation of R Si (i, j + k) as follows: 

(i) k = 0: 

For k = 0, a, and a i+k are in the same position of the same codeword. 
Thus, 



RsXi,J) = X A?P(A,| St ,j) 



where 



P(A, | S t , j) = Pifli = A, | 8 t - S t ). 
(it) k = 1, 2, • ■ ■ , L: 



(11) 
(12) 



For this range of k, a i+k is in the same codeword as a, for j ^ L — k, 
and is in the next codeword for j > L — k. Thus, 



Rsiii, i + k) 



£ £ A,A m P,(A, , A m | S< , j), j^L-k 



1 = 1 m-l 



E T,A t A m J^PiAi.SnlSoJ) 



(13) 



J-l m-I 



■P(A m \S n> j + k- L), j> L - k 



where 



P(A t , S n | St , j) = P(a, = A, , s i+L = S n | 8, = S t ). (14) 

(in) k = L + 1, L + 2, • • • , 2L: 

For this range of /c, a J+fc is in the codeword immediately following 
the codeword containing a, for j ^ 2L - k, and is two codewords away 
for j > 2L - k. Thus, 

Rati, j + k) 

\t t^A m X)P(A, , flL|A, i) 



•P(A m | & , ; + k - L), j £2L-k 

M At N N 

IEuZ p (^< . ft I -s, , i) E ^(ft I ft) 

1=1 m-l n=l P=l 

•PCA,,. I 8, , i + ft - 2L), j>2L-k 



(15) 
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where 

Pi(S, | S n ) = P(s i+L = S v I s, = S n ). (16) 

(iv) k - QL + 1, QL + 2, • • , (Q + 1)L for Q £ 2: 

For this range of fc, a J+t is in Qth codeword following the codeword 
containing a, for ; ^ QL — /c, and is Q + 1 codewords away for j > 
QL - k. Thus, 

Rati, i + k) 

E E ^M- E P (^< . S- I S t , j) E Pg^OS, | so 

1-1 m-l n=l p=l 

•P(A m | S p , ; + fc - QL), j^QL-k (n) 

IT jtf N N 

E E a.a. E P(A t , s n | s< , j) E Po(s, I s n ) 

1-1 m=l n=l p=l 

•(A. | S p , j + fc - (Q + 1)L), j>QL-k 
where 

P (S P | S n ) - E Pq-i(<S< I <S»)Pi($- I &), Q i> 2 (18) 
<=i 

and can be calculated recursively. 

In summary, then, the procedure described in eqs. (11) through (18) 
is used to calculate {R Si (j, j + k)} which is substituted in eq. (10) to 
obtain {R(k)\. The spectral density wjj) can then be obtained from 
{R(k)) by means of eq. (3). 

It is easily seen that for any code other than the most trivial, the 
calculation of the spectral density is a formidable task. However, it 
is a relatively straightforward procedure to program a digital computer 
to perform the above calculations; and this is the most profitable use 
of the procedure. 

IV. THE CODED SIGNAL STATISTICS 

The calculation of the spectral density described above requires the 
knowledge of numerous probabilities concerning the code. These 
statistics are, in general, readily obtainable from the code by merely 
counting the number of occurrences of the phenomenon involved, or 
are determined from simple calculations involving previously obtained 
probabilities. The procedure for obtaining each of the necessary prob- 
abilities follows: 
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(i) The State Transition Probabilities: 

P 1 (S P | S n ) = P(s i+l = S p | s,- = £„); p, n = 1, 2, • • • , N. (19) 

This transition probability is obtained by counting the number of 
codewords in the alphabet used when in state S„ , whose next state is 
S p . (Given any codeword in any state, the next state is uniquely denned 
at the end of that codeword.) The resulting sum is divided by the 
number of codewords in the alphabet. The probability of a transition 
from state S n to S p in Q steps, P Q (S P \ S n ), can be calculated recursively 
from P,(S, | S n ) via eq. (18). 

(it) The State Probabilities: 

P(Si) = P(s n = S.)j % = 1, 2, • • • , N. (20) 

The probability of being in state S { is calculated from {Pi(S p \ S n )}. 
\P(Si)} are the solutions to the set of simultaneous linear equations 

E P(S k yP(8, I S k ) = W; j = 1, 2, ■ • • , N. (21) 

However, only N — 1 of these equations are linearly independent. 
An additional equation must be used: 



{in) The Symbol Probabilities: 
P(A t | 8 { , i) = P(a, = 



These probabilities are determined by counting the number of 
occurrences of symbol A, in the ;th position of the codewords in the 
alphabet used when in state S { . This sum is divided by the number 
of codewords in the alphabet. 



i-i 




(22) 


lities: 
\a, = Si); t- 1,2, •• 


■ ,N 




i« 1,2, ■■ 


• ,L 




1-1,2,-. 


■ ,M. 


(23) 



(iv) The Symbol Combination Probabilities: 




P k (Ai , A m | S< , j) 




= P(a,- = A t , a, +t = A m \ s n = S,); » ■ If 2, •■ 


,iV 


i- i,a. •• 


,L 


Z, m = 1,2, •• 


,M. 


fc ^ L - j 


(24) 
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This is the probability of the occurrence of the symbols A t and A m , 
in time slots j and j + k respectively, within the codewords of the 
alphabet used in state S t (i.e., k ^ L — j). Thus, for position j of the 
alphabet of S, , the number of times a, = A t and a j+k = A m in the 
same codeword are counted, and divided by the number of codewords 
in the alphabet. 

(y) The Conditional State Transition Probabilities: 
P(A l , S n | S< , j) 

= P(aj = A, , s i+L = S n | s, = Si); i, n = 1, 2, • • • , N 

j= 1,2, • •■ ,L 
I = 1,2, ••• ,M. (25) 

This is the probability that a codeword in the alphabet of state £,• 
has the symbol A t in the jth position and has the state *S n as its next 
state. Thus, the number of times that a codeword is in the alphabet 
of state St , whose next state is £„ and whose symbol level is A t in the 
jth position, are counted, and divided by the number of codewords 
in the alphabet. 

These five sets of statistics are all that are required to perform the 
calculation of the spectral density. Although following the procedures 
for obtaining these probabilities is a very straightforward task, it is, 
again, a tedious one, especially for any reasonably complex code. Here 
again, the digital computer can be used to good advantage. 

V. AN EXAMPLE-THE FRANASZEK MS-43 CODE 

The Franaszek MS-43 code 1 is a ternary, 4-state, 3-alphabet code 
of word length 3. It is one of a family of codes designed to produce a 
digital pulse train with specific desirable properties. These properties 
include the absence of a dc component, a bounded sum of previous 
digits, and a strong spectral component from which the signaling 
frequency can be derived. The code is shown in Table I. Alphabet Ri 
is used when in state Sj , alphabet R 2 is used in state £ 2 or S 3 , and 
alphabet R 3 is used in state S 4 . The state is determined at the end of 
a codeword by summing all previous digital symbols. This sum is 
inherently restricted to be 1, 2, 3, or 4 corresponding to states S t , S 2 , 
S 3 , and Si . Tables II through VI list the statistics necessary for cal- 
culating the spectral density as determined by the procedures described 
in Section IV. The digital computer was utilized to perform the spectral 
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Table I— The MS-43 Code 



Binary 

Input 

Words 


Ri 


R 2 


R 3 


0000 


+++ 


-+- 


-+- 


0001 


+ +0 


00- 


00- 


0010 


+0 + 


0-0 


0-0 


0100 


+ + 


-00 


-00 


1000 


+- + 


+- + 





0011 


0- + 


o- + 


0- + 


0101 


-o + 


-+0 


-o+ 


1001 


00 + 


00 + 


--0 


1010 


0+0 


0+0 


-0- 


1100 


+00 


+00 


0-- 


0110 


-+o 


-+o 


-+o 


1110 


+ -o 


+-o 


+ -0 


1101 


+0- 


+0- 


+0- 


1011 


o+- 


+ - 


+ - 


0111 


-++ 


-++ 


-- + 


1111 


++- 


+-- 


+-- 



Table II — State Transition Probabilities 
for MS-43 Code 

Pl(S p \S n ) 





P 


n 


1 


2 


3 


4 


1 


6/16 


6/16 


3/16 


1/16 


2 


5/16 


6/16 


5/16 





3 





5/16 


6/16 


5/16 


4 


1/16 


3/16 


6/16 


6/16 
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Table III — State Probabilities for 
MS-43 Code 



i 


P(8i) 


1 


5/28 


2 


9/28 


3 


9/28 


4 


5/28 



density calculation. The resulting normalized spectrum is plotted in 
Fig. 1. The result is consistent with the expected properties of the 
coded signal spectrum, i.e., zero dc component and periodicity with 
period \/T. 

VI. CONCLUSION 

A general procedure for determining the average power spectral 
density of a coded digital signal has been presented. The procedure is 
long, but straightforward and readily programmable on the digital 
computer. With the aid of the computer, the spectral content of signals 
resulting from the implementation of large numbers of codes can be 
obtained. 
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Table IV — Symbol Probabilities for 
MS-43 Code 

P(A m \S„j) = P(A m \Si), Vj = 1, 2, 3 





Si 


A m 


s, 


& 


s 3 


s 4 


+ 


8/16 


5/16 


5/16 


3/16 


- 


3/16 


5/16 


5/16 


8/16 
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Table V — Symbol Combination Probabilities 
for MS-43 Code 

P k (A t ,A m \Si,j) 

3 = 1, k = 1 





Si 


A t A m 


St 


& 


s 3 


S t 


+ + 


3/16 











+ - 


2/16 


3/16 


3/16 


2/16 


- + 


2/16 


3/16 


3/16 


2/16 














3/16 


3 = 1, k = 2 




Si 


A t A m 


s t 


s 2 


s 3 


s t 


+ + 


3/16 


1/16 


1/16 





+ - 


2/16 


2/16 


2/16 


2/16 


- + 


2/16 


2/16 


2/16 


2/16 


-- 





1/16 


1/16 


3/16 


j = 2,k = \ 




Si 




A c A m 


Si 


s 2 


s 3 


s< 


+ + 


3/16 


3/16 


1/16 





+ - 


2/16 


2/16 


2/16 


2/16 


- + 


2/16 


2/16 


2/16 


2/16 








1/16 


1/16 


3/16 
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H 

Q 
O 

O 

CO 

2 



M 

O 

CO 

S 

— i 
« 

« 
O 

M 
Ph 

Eh 55. 
| «rf 

M S 
H ft, 

H 

H 

J 

o 



Q 
Z 

o 

o 



< 















CO 


CO 


CO 


CO 


CO 


CO 








CO 


o 


O 


-H 


^J_ 


T-H 


r-H 


r-H 


r-H 














r-l 


CN 


i— 1 


CN 


CO 


CN 














CO 


CO 


CO 


CO 


co 


co 




co 




CN 


o 


o 


























<— 1 


CN 


r-H 


N 


CO 


CN 














CO 


CO 


CO 


O 


CO 


CO 








i— I 


o 


o 


























r-H 


CN 


T-H 


CN 


CO 


CN 














CO 


CO 




co 


co 










CO 


o 


o 


r-H 

CN 


H 

CO 
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r-H 

CO 


I-H 

CN 


O 












VD 


CO 


CO 




CO 


CO 


CO 




CO 




CN 
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r-H 


r-H 


^_ 
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r-H 


r-H 


r-H 










*"* 


CN 


CN 




CN 


CN 


r-H 
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cO 


CD 




CO 


CO 


CO 








r-l 


o 


i-H 


i— i 


^_ 


o 




^ 


r-H 












I-H 


CN 


CN 




CN 


CN 


r-H 


CO 




-r -> 
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CO 




CO 


CO 












CO 


o 


CN 


CO 


O 


CO 


CN 


© 


O 












(O 
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CO 


CO 


CO 
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^ 
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^_ 
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OQ 






1— 1 


CN 


IN 




CN 


CN 
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CO 


CO 




CO 


CO 


CO 










i— i 
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^ 


J^ 


o 








o 
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CN 
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CN 


1—1 
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CO 


CO 












CO 














o 


o 










CN 


CO 


CN 


1—1 


CN 


1— 1 














CO 


CO 


CO 


CO 


CO 


CO 








CO 




CN 
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o 










CN 


CO 


CN 


t— I 
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CO 


CO 


CO 


CO 
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Fig. 1 — Power spectral density for the Franaszek MS-43 code. 

of a private communication from A. Fromageot discussing the problem 
of calculating the spectral density of the Franaszek MS-43 code. 
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